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MISSION STATEMENT 



The mission of the Wisconsin Research and Development Center 
is to improve the quality of education by addressing the full 
range of issues and problems related to individualized schooling. 
Teaching, learning, and the problems of individualization are 
given concurrent attention in the Center's efforts to discover 
processes and develop strategies and materials for use in the 
ychools. The Center pursues itw missi'on by 

• conducting ond synthesizing research to clarify the 
proccKHC'S of school-ago chi ldrf?ru!»^learning <>nd 
development ^ * 

• conducting and synthesizing tr'soarch to cjarlfy effective 
approaches to teaching students basic skill.s and concepts 

• developing and demonstrating improved instructional strategies, 
processes, and materials for students, teachers, and school 
administrators 

• providing assistance to educators which helps transfer the 
outcomes of research. and development to improved practice 
in local schools and teacher education institutions 

The Wisconsin Research and Development Center is supported 
with funds from the National Institute of Education and the 
University of Wisconsin. 
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Abstract 



/ 

This report is one in a series of papers which provide defini- 
tions of and descriptive data on the variables .used in the Comparative 
Study of Phase IV of the IGE Evaluation Project* Specifically, it 
focuses on two aspects of curriculum program use: Curriculum Implem- 
entation , a measure of \he degree to which the Wisconsin Design for 
Reading Skill Development (WDRSD) or Developing Mathematical Processes 
(DM?) is implemented, and Program Customizing, a measure of the extent 
to which the curriculum in use is altered to meet individual children's 
needs. Verbal definitions, a list of . questionnaire items from which 
the variable was developed, a detailed explanation of the scaling 
procedures, and a description of the distribution of the variables are 
provided . 

t 



ix 

8 



Introduction 



The IGE Evaluation Project has as a central objective the 
identification of features of IGE schooling which contribute to success- 
ful instruction # especially in reading skills and mathematics (Romberg, 
1976) . ^ Although the first four phases of this project focused on 
different aspects of IGE, they were designed to provide cbmplementary 
data bases resulting in a coirprehensive description of this form of 
schooling. With this goal in mind Phase IV was designed to supplement 
information collected in Phases I and III by providing detailed informa- 
tion on a small number of curricular and instructional variables • That 
is, whereas these phases investigated organizational, system, general 
means of instruction, and general achievement variables, the main 
purpose of Phase IV was to investigate the three R&D Center-produced 
curriculum programs whose instructional procediires and materi^als were 
specifically designed to be compatible with instructional programming 
for the individual student. These programs are the Wisconsin Design for 
Reading Skills Development (WDRSD) , (Otto, 1977); Developing Mathematical 
Processes (DM?) , (Romberg, 1977); and Prereading Skills (PRS), (Venezky 
& Pittelman, 1977) . 

Phase IV was divided into two parts — the Descriptive Study and the 
Comparative Study— and information on the design and piocedures used 
during each portion may be found in Project Papers 79-42 (Webb & Romberg, 
1979) and 80-2 (Romberg, Webb, Stewart, and Nerenz, 1980). Briefly, each 
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part was designed to provide detailed information on two variables — 
means of instruction and pupil out comes —using achievement monitoring and 
domain referenced tests, teacher logs, and classroom observations. In 
addition, a smaller amount of information on background, organizational, 
and program variables was obtained from questionnaires completed during 
structured interviews with principals, unit leaders, and teachers. This 
information is used as the basis of the six variables, considered in 
paper 80-7 (Nerenz, Stewart, and Webb), and the program use variables 
which are examined in thlis paper. 

I 
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II 

Scaling of Program Use Variables 



DEFINITIONS 

The Curriculum Implementation variable is a measure of the 
ejctent to which WDRSD or DMP is used. Both WDRSD and DMP were designed 
to be compatible with IGE*s Instructional Programming Model; that is, 
each product include^ instructional objectives, related evaluation 
procedures, record-keeping procedures, and suggested instructional 
activities in sufficient variety 1:hat instruction may be adapted to 
student characteristics. Users of WDRSD or DMP m^y choose to use all 
I^arts of the program or only selected elements; users may also choose 
to use other products in the same curriculum area jointly or with one 
product supplemental to the other (s) . 

Program Customizing is a measure of alterations made to meet the 
specific needs of individual students. It includes subscores for pro- 
gram a^daptation, provision for review and reinforcement, and teacher 
development of materials. 

CURRICULUM IMPLEMENTATION, SCALING 

For both programs, the maximum number of points is 10. 

WDRSD 

The score provides an indication of tKe extent to which the 
different elements of the WDRSD program are used and the way in which 
they, are implemented. Although points are assigned differently at 
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grades 2 and 5, the number of possible points is the same at each 



grade level. 



Word Attack Implementation 
Points 



Grade 2 



Grade 5 



15 



5 



15 



As the basis for word attack 
skill instruction. 

To monitor word attack skill 
development after instruction 
in the regtuLar reading program, 
such as the basal reader program. 



As the basis for instruction and 
to monitor skill development. 



Study Skills Inqplementation 
Po ints 

Grade 2 Grade 5 



12 Form skill groups and instruct 

Study Skills within the content 



areas .\ 



\ 



Form skill groups and alternate^ 
instruction of Study Skills with 
instruction in Comprehension 
skills within the reading block. 

4 Form skill groups and alternate 

instruction of Study Skills with 
% instruction of Word Attack skills 

within the reading block. 

8 Form skill groups and instruct 

Study Skills during a special 
skill period set aside for Stu<iy 
Skill instruction 

8 Form skill groups and alternate 

instruction of Study Skills with 
ins1:ruction in Self-Directed, Inter- 
pretive, and Creative Reading skills 



12 



5 



Comprehension Implementat ion 
Points 

Grade 2 Grade 5 



4 



4 



12 



12 



8 



8 



12 



4 



Form skill groups and alternate 
instruction of Comprehension skills 
with instruction of Vford Attack 
skills within the reading block. 

Form skill groups and instruct 
Comprehension skills within the 
reading block every day. 

Form skill groups and instruct 
Comprehension skills outside of 
the reading block every day* 

Form skill groups and alternate 
instruction of Comprehension skills 
with instruction of Study Skills 
within the reading block. , 

Form skill groups and alternate 
instruction of Comprehension skills 
with instr\iction of Self -Directed r 
Interpretive, and Creative Reading 
skills within the reading block. 

Form skill groups and instruct 
Comprehension skills within the 
content areas. 

Alternate skill instruction in all 
skill areas. 



Other Implementation . 

Points ^ 
Grade 2 Grade 5 



Implementation of Self-directed, 
Interpretive, or Creative reading. 

Use of the pviblished list of 
materials in each folder of the 
Teacher's Resource File. ^ --^^ 
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TOTAL SCORE 

Since multiple responses were possible for the Study Skills and 
Comprehension elements / points for those elements were summed to ^ 

number no larger than the maximum number of points assigned for 6uiy 

. . 

single type of inplementation. Then, scores for each teacher were summed 
across all elements to a maximum of 30 points and divided by 3 for scores 
ranging from 0 to 10. An average score was calculated for each school. 

Those respondents who provided information only on the number 
of WDRSD elements which were implemented rather than on the number of 
elements and the manner in which they were inplemented were assigned 
the smallest number of points for each element, thus receiving a total 
of 9. ^ 

DMP 

This variable measures the degree to which DMP is being inplemented, 
Points were assigned for Grades 2 and 5 as follows : 

Main or supplementary program > (1 to 6 points) : 

6 points DMP is the main program or it is the main 

program with supplementary materials added. 

3 points / DMP and another program are used jointly. 

1 point DMP is used as a supplementary program. 

DMP Materials (0 to 3 points) 

2 points The resource manual is used. 

1 point At least two other types of materials such 

as workbooks/ student guides ^ manipulatives, 
and games are used. 
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Pupil performance card (0 or 1 point) 

1 point Pupil performcince cards are used. 

The number of points were suiraned for each teacher, and then averaged 
across teachers within each school. 

PROGRAM CUSTOMIZING SCALING 

This variable measures the extent to which a Grade 2 or Grade 5 
reading or mathematics program has been customized. Three aspects of 
customization were measured: adaptations to children's instructional 
needs, provision for review and reinforcement, and teacher development 
of materials. 

Adaptations . Adaptations were defined as changes, additions, 
and deletions in the curriculum program and two facets of program adapta- 
tions were considered. The first is whether the program is adapted to 
meet instructional needs. The second is whether the existence of multiple 
instructional programs leads to duplication of instruction. 

Meeting Instructional Needs (0 or 5 points) 

Adaptation 

5 points At least one reported adaptation 

reflected attention to children's 
individual needs. (Responses 1,2, 
3,4,6,7,10,11,12,13,16) 

\ 

/ 

Duplication of Instruction (-3 or 0 points) 

Adaptation 

-3 points 

More than one instructional program 
is used and duplicate instruction 
is provided or more thein one in- 
structional program is used but the 
programs do not complement each 
other. 

15 



Points obtained for these two responses reflecting program adaptations 
were summed for each teacher. 

Provision for Review and Reinforcement . In that skills which are 
taught in relative isolation should be both reinforced in different settings 
and reviewed as the basis of subsequent instruction, provisions for review 
and reinforcement weTre considered to be an essential aspect of program use* 
Due to differences in the math and reading skills questionnaires, different 
responses were used in determining whether 3 points were assigned. 



Math 



Teacher Response 

Provisions are made for application and 
continuation of skills during math class. 



Reading 



At least one of the following j 

a) provisions for reviewing 
skills in other content^ areas 

b) application and con\:Lnuation of 
skills 

^ c) scheduling of formal s/kill/review 

sessions ' 

i 

d) frequent teaching and reinforcement 
of reading skills during instruc- 
tion in other areas 

/ 

Teacher development of materials > One point w^ assigned for each 
teacher reporting preparation of special materials. 

Composite score . Subscores were summed for each teacher and averages 
were calculated for each school* Possible values range from -3 to 9. 
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III 

Suimnary Statistics for the Scaled Variables 

The scaled program use variables are described In Table 1 In 
terras of the mean, standard deviation, actual maximum and minlmiim values 
obtained, and. logical maximum and minimum values obtainable. Number of 
schools responding to the questlonnarles is also shown. Figures 1 and 2 
show histograms of the scaled variables. 



TABLE 1 

Summary Statistics for Program Use Variables 



Variable 


No. of 




Standard 


Obtained 


Obtained 


Logical 


Logical 


schools 


Mean 


deviation 


maximum 


minimum 


maximum 


minimum 


Curriculum Implementation 














WDRSD 


11 


A.5A5 


3. 314 


9.25 


0.00 


10 


0 


DMP 


8 


5.250 


A. 743 


10.00 


0.00 


10 


0 


Program Customizing 
















Reading study 


11 


1.705 


.974 


4.00 


.50 


9 


-3 


Math study 


8 


1.250 


.926 


3.50 


.50 


9 


-3 


Total sample 


19 


1.513 


.956 

/ 


4.00 


.50 


9 


-3 
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APPENDIX 



Items for WDRSD/Reading and DMP/Math^ 
Program Use Variables 



In this appendix, items are labeled so that the first letter 
identifies the questionnaire respondent (see below) and /the remaining/ 
letters and numbers give the location of the item in the original / 
questionnaire. In that the math and reading teacher questionnaires 
were similar, teachers were asked to respond only to the questionnaire 
relevant to the study in which their school participated. 



First letter 



Respondent 



principal 



U 



unit leader 



R 



teacher, reading 



M 



teacher, math 
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WDRSD IMPLEMENTATION 



R02A1 If WDRSD is among the programs being used, then: 

Which elements are used? (All may apply; / 1, blank =^ 0) 

Word Attack 

Study Skills 

Comprehension 

Self-Directed Reading 

Interpretive Reading 

Creative Reading 



R02A2 If the Word Attack Element is implemented: j 

Which one statement applies to your implementation of the 
Design Word Attack Element: 

(1) as the basis for word attack skill instruction, 

(2) to monitor word attack skill development after 
instruction in the regular reading progrcun, such 
as the basal reader program. 

(3) I haven't worked with it for a number of years. 

(4) combination of 1 and 2. 

R02A3 If the Study Skills Element is implemented r check the 

procedure or procedures that best describe implementation 
of the Study Skills Element in your unit (class or grade 
level) • 

1. Form skill groups and instruct Study Skills within 

the content areas. 

2. Form skill groups and alternate instruction of Study 

Skills with instruction of Comprehension skills with- 
in the reading block. 

3. Form skill groups cuid alternate instruction of Study 

' Skills v»ith instruction of Word Attack skills within 

the reading block. 

4. Form skill groups and instruct Study Skills during 

a special skill period set aside for study skill 
instruction. 

5. Form skill groupe and albernato Inafruction of 

Study Skills with instruction in Self -Directed, 
Interpretive, and Creative Reading skills. 
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R02A4 



e Comprehension Element is implemented: 



Check the procedure or procedures that best describe 
ingplementation of the Conprehension Element in your 
unit (class or grade level) . , 



1. 

2. 
3. 

4. 

5. 
6. 



Form skill groups ahd alternate instruction 
of Comprehension skills with instruction of 
Word Attack skills y^ithin the reading block. 
Form skill groups and instruct Conprehension 
skills within the/ reading block every day. ' 
Form skill groups and alternate instruction 
of Conprehension' skills with instruction of 
Study Skills wit;!iiin the reading block. 
Form skill groups and alternate instruction 
of Comprehensipn skills with instruction of 
Self-Directed, Interpretive , and Creative 
Reading skilly within the reading block. 
Form skill groups and instruct Comprehension 
skills withir) the content areas. 
Alternate sk^ll groups. 



R04B1 



Do you use the list of published materials in each 
folder of the Teacher *s Resource File? 



(0) No 

(1) Yes 



DMP IMPLEMENTATION 



M02B 



MU2G 



If DMP is ainong the programs being used, then which one 
statement applies to your implementation of the program? 

(1) DMI^ j^s used as the* main math program. 

(2) DMP is used as the main math program but is supple- 
men t^ed by some teacher-made materials. 

(3) DMP and another math program are used jointly. 

(4) DMP is used as supplementary material for some 
other math program. 

What materials from the DMP progrcun do you use? 

/resource manual 

workbooks 

student guides 

^ ma:iipulatives 

games 



M06DA 



Do yc;^u use pupil-performance cards? 



ERIC 



(0) No 
U) Yes 
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INSTRUCTIONAL PROGRAM CUSTOMIZATION 



ADAPTATIONS TO CHILDREN'S INSTRUCTIONAL NEEDS 



R05Bi 



Have you adapted (changed/added/deleted) the WDRSD 
(reading) skills program to fit your specific needs? 

(0) No 

(1) Yes 



M05B1 



Have you adapted (changed/added/ deleted) the DMP (math) 
program to fit your specific needs? 

(0) No 

(1) Yes 



R05B2 



If yes y what adaptations have you made? 
adaptations reported.) 



(Possible three 



(01) only teach skills child needs and reinforcement 

(02) added individualized kit 

(03) teacher thought of easier approach than provided 
by text 

(04) supplement with materials at school or teacher • 
maae including games 

(05) one teacher has become WDRSD Coordinator 

(06) teacher read some Level C test questions instead 
of children reading them 

(07) have combined some skills; added some library 
exercises 

(08) we have deleted 

(09) teacher tries not to teach syllogistic reasoning; 
they get all goofed up, just do some sheets 

(10) Study Skills; added some materials 

(11) Had to gather extra materials to meet needs of 
students for Comprehension Skills 

(12) Changed games to worksheets i worksheets to geunes 

(13) Thought up some more activities for skills taught 
in WDRSD 

(14) For lower kids with reading problems in Word Attack 
criteria to pass most skills is inappropriate 

(15) Deleted schwa D level and accents 



25 



22 



it yc^, what adaptations have you made? 



(01) only teach skills child 
needs and reinforce 

(02) add individualized kit 

(03) teacher thought of easier 
approach than provided by 
text 

(04) supplement with materials 

at school, including games * 
or teacher-made materials 

(05) one teacher has become DMP 
coordinator 

(07) have combined some skills 

(08) we have deleted 

(11) had to gather extra materials 
to meet needs of students, 
drill sheets 

(12) changed games to worksheets; 
worksheets to games 

(13) thought up some more activi- 
ties for skills taught 

(16) added a unit 

(17) teacher has to read much of 
DMP with kids.* They fail to 
see humor in problems and 
names. 

(18) on Topic 37/ left out group- 
ing part (review) and kids 
did much better 

^^^^•^ ^^^^ than one reading program is noted above, then 

Do the programs have overlapping content? 

(0) No 

(1) Yes 

If yes, are students routinely given "duplicate instruction? 

(0) No 

(1) Yes 

» 



ERIC 



26 



23 



R02B2 



How do the programs complement each other? 



(1) They teach and reinforce the same basic skills 
but with different approaches, in different 
ways. 

(2) Use same terminology in multiple areas 

(3) Both use systematic building of skills approach 

(4) They learn the basic skills in reading program and 
De s iqn ; pro j ec ts let them apply skills 

(5) They don't! 

(6) They both work toward skills in comprehension 

(7) Teacher adds own creative materials to better 
implement program. 



M02C1 
M02C1 



If more them one math program is noted above, then 
Do the programs have overlapping content? 



(0) No 

(1) Yes 

If yes , are students routinely given "duplicate" instruc- 
tion? 

(0) No 

(1) Yes 



MU2B2 



How do the programs complement each other? 



(1) They teach and reinforce some basic skills but with 
different approaches 

(2) Use same terminology 

(3) Both use systematic building of skills approach 

(4) Use commercial text to supplement design, fill 
in holes or for more practice 

(5) They don'tl 
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PROVISION FOR REVIEW AND REINFORCEMENT 



R02B3 



What provisions are made for review or reinforcement of 
skills taught in each program? 



(1) Up to the teacher; can refer to WDRSD when skills 
come up in basal 

(2) Posttests — — 

(3) Workbooks 

(4) Map skills and other projects in other areas 

(5) Some overlapping; review of skills in other con- 
tent ,^reas 

(6) Application and continuation of skills during 
reading block or other subject areas 

(7) With WDRSD, if they don't master a skill they have 
to do it again 

(8) No formal provisions are made 

(9) Followed up by next level 



R02F4 



Do you ever schedule f* :n/ skill sessions to review 
skills students have me^i ^ .ved? 



(0) No 

(1) Yes 



R02F5 



To what extent do you teach jot reinforce reading skilifs"^ 
during instruction in other content areas (i.e,, social 
studies, science)? 



(0) Not at all 
(1) 

(2) Sometimes 
pi Quite a bit 

^4) Continuously and consciously 



M02C3 



What provisions are made for review or reinforcement of 
objectives taught in each progrcm^? 

(1) do review sheets or more pages in text 

(2) posttests 

(6) application and continuation of skills during math 
class 

(8) no formal provisions made 
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TEACHER DEVELOPMENT OF MATERIALS 



R03A 



H ive you prepared any special materials for us^ in your 
WDRSD (reading) skill group? 



(0) No 

(1) Yes 



M03A 



Have you prepared any special material.3 for use in your 
math groups? 



(0) No 

(1) Yes 
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